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Abstract 

Logconcave functions represent the current frontier of efficient algorithms for samphng, opti- 
mization and integration in R" [LV06a| . Efficient sampfing algorithms to sample according to a 
probability density (to which the other two problems can be reduced) relies on good isoperimetry 
which is known to hold for arbitrary logconcave densities. In this paper, we extend this frontier 
in two ways: first, we characterize convexity-like conditions that imply good isoperimetry, i.e., 
what condition on function values along every line guarantees good isoperimetry? The answer 
turns out to be the set of (l/(n— 1)) -harmonic concave functions in R"; we also prove that this is 
the best possible characterization along every line, of functions having good isoperimetry. Next, 
we give the first efficient algorithm for sampling according to such functions with complexity 
depending on a smoothness parameter. Further, noting that the multivariate Cauchy density is 
an important distribution in this class, we exploit certain properties of the Cauchy density to 
give an efficient sampling algorithm based on random walks with a mixing time that matches 
the current best bounds known for sampling logconcave functions. 

1 Introduction 

Over the past two decades, logconcave functions have emerged as the common frontier for the 
complexity of sampling, optimization and integration. More precisely, given a function / : M" — > 
M-I-, accessible by querying the function value at any point x G M", and an error parameter e > 0, 
three fundamental problems are: (i) Integration: estimate J f to within 1 ± e, (ii) Maximization: 
find X that approximately maximizes /, i.e., f{x) > (1 — e)max/, and (iii) Sampling: generate x 
from density tt with (it^(7r,7rj) < e where dtv is the total variation distance and vrj is the density 
proportional to /. (For each of these, exact solutions are intractable.) 

The complexity of an algorithm is measured by the number of queries for the function values 
and the number of arithmetic operations. The most general class of functions for which these 
problems are known to have polynomial complexity in the dimension n, is the class of logconcave 
functions. A function / : M" is logconcave if its logarithm is concave on its support, i.e., for 

any two points x,y £ M" and any A G (0, 1), 

/(Ax+(l-A)y)>/(x)V(2/)'-^ (1) 

This powerful class generalizes indicator functions of convex bodies (and hence the problems sub- 
sume convex optimization and volume computation) as well as Gaussians. Following the celebrated 
result of Dyer, Frieze and Kannan |DFK91| giving a polynomial algorithm for estimating the volume 
of a convex body, a long line of work |AK91[ ILovQni IDFOTI lLS92l iLSMl IKLS971 iLVnTl ILVOGcl ILVOGbj 
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culminated in the results that both sampling and integration have polynomial complexity for any 
logconcave density. Integration is done by a reduction to sampling and sampling also provides 
an alternative to the Ellipsoid method for optimization [BV041 [KV061 iLVOGaj . Sampling itself is 
achieved by a random walk whose stationary distribution has density proportional to the given 
function. The key question is thus the rate of convergence of the walk, which depends (among 
other things) on the isoperimetry of the target function. Roughly speaking, isoperimetry is the 
minimum ratio of the measure of the boundary of a partition of space into two sets to the measure 
of the smaller of the two sets. Logconcave functions satisfy the following isoperimetric inequality: 

Theorem 1. \DF91\ [LSOS^ Let vrj be a distribution in M" with density proportional to a logconcave 
function f. Let K be the support of f, D the diameter of K and 31,82,83 be any partition of K. 
Then, 



where d{8i, 82) refers to the minimum distance between any two points in 81 and 82- 

While these results are fairly general, they do not capture the complete class of functions which 
have good isoperimetry. Logconcave functions in M" are defined by a convex-combination based 
condition for every two points in the support of the function, saying that the function is logconcave 
along every line. This is a generalisation of the case of convex bodies where we have that the line 
segment connecting any two points in the body lies completely within the body. This motivates the 
following question: What is the condition that needs to be satisfied along every line by a function, 
for it to have good isoperimetry? 

In this paper, we present the complete class of functions with good isoperimetry that can be 
described by such convex-combination based conditions. We also give an efficient algorithm to 
sample from these functions. Further, we identify the Cauchy density (which is not logconcave) 
as a well-known example in this set of functions and obtain an efficient algorithm for sampling 
the multivariate Cauchy density restricted to a convex body. Its complexity matches the best- 
known bounds for logconcave functions. We note that the density functions satisfying the convex- 
combination based characterization that we present here, could be heavy-tailed with unbounded 
moments as is the case with the Cauchy density. 

To motivate and state our results, we begin with a discussion of 1-dimensional conditions. 

1.1 From concave to quasi-concave 

A function / : M" is said to be 




concave if. 




logconcave if. 




< 



s -harmonic- concave if, / (Ax -|- (1 — A)y) > 




^ quasi- concave if. 




for all A G [0, l],Vx,y G M". 
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These conditions are progressively weaker, restricting the function value at a convex combination 
of X and y to be at least the arithmetic average, geometric average, harmonic average and minimum, 
respectively. Note that s = 1 gives the usual harmonic average (and si-harmonic-concave functions 
are also S2-harmonic-concave if si < 52). It is thus easy to verify that: 

concave C logconcave C s-harmonic-concave C quasi-concave. 

Relaxing further would violate unimodality, i.e., there could be two distinct local maxima, which 
appears quite problematic for all of the fundamental problems. Also, it is well-known that quasi- 
concave functions have poor isoperimetry. 

We note here the relation between the s-harmonic-concave probability density function and the 
probability measure as shown by C. Borell [Bor74l [Bor75] . This gives an equivalence between the 
one-dimensional convexity- like condition to a condition on the probability measure of the function. 

Lemma 2. Let —00 < k < ^. An absolutely continuous probability measure ji on M" is K-concave 
if and only if it is concentrated on an open convex set K in M" and has there a positive density p, 
which is K.{n) — concave for Hi{n) = • 

Thus, we have that if the density function is s-harmonic-concave for s G [0, 1/n], then the 
corresponding probability measure is K-concave for k = jE^- Further, Bobkov |Bob07] proves the 
following isoperimetric inequality for K-concave probability measures for —00 < k < 1. 

Theorem 3. Given a K-concave probability measure ji, for any measurable subset A C M", 

K^A) > ^ min{^(^), 1 - ^i{A)Y-'^ 
m 

where m = Jjg„ \x\d^{x), for some constant c{k) depending on k. 

Using the characterisation given by C. Borell in Lemma [21 one can obtain a weaker form of 
isoperimetric inequality from the above theorem for s-harmonic-concave functions / : M" — > M+ for 
s > ^ to say that for any measurable subset A, for some constant c(s) depending only on s, 

vr/(<5A) > ^ mm{7rf{A), 1 - 7rf{A)}^+T^ 

We note that our result gives a stronger inequality, in the sense that, we remove the dependence 
on s from the inequality completely. We prove such an inequality for the more general class of 
^^^^^ -harmonic-concave functions rather than (i) -harmonic-concave functions. We proceed to 
show that the limit of isoperimetry for convex-combination based conditions along every line for 
the density function, is the set of (l/(n — l))-harmonic-concave functions. Further, we address the 
problem of sampling from such distributions restricted to any convex set (possibly unbounded). 



1.2 The Cauchy density 

The generalized Cauchy probability density / : R_|_ can be written as 

det(^)-^ 



„x (n+l)/2 ■ 

l + \\Aix-m)f^ 



f{x) oc 



where A £ Mnxn- For simplicity, we assume m = using a translation. It is easy to sample 
this distribution in full space (by an affine transformation it becomes spherically symmetric and 
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therefore a one-dimensional problem) [Joh87j . We consider the problem of sampling according to 
the Cauchy density restricted to a convex set. This is reminiscent of the work of Kannan and Li 
who considered the problem of sampling a Gaussian distribution restricted to a convex set |KL96] . 

The Cauchy density function belongs to the broader class of Levy skew alpha-stable distribu- 
tions (or simply known as stable distributions) |Man06t INol09j which are useful in modeling many 
variables in physics and mathematical finance. Unlike most stable distributions, Cauchy densities 
have a closed form expression for their density. Being a 1-stable distribution, it finds useful applica- 
tions in a variety of problems including the approximate nearest neighbor problem and dimension 
reduction in h norm |Ind06[ iDllMOil ILHCOT] . 

1.3 Our results 

Our first result establishes good isoperimetry for l/(n — l)-harmonic-concave functions in R*^. 

Theorem 4. Let f : R" be a (l/(n — 1)) -harmonic- concave function with a support K . Let 

M" = 5i U ^2 U ^3 he a measurable partition ofW^ into three non-empty subsets. Then 

vr/(53) > ^^^^^^^^min{7r/(5i),7r/(52)} , 

where D is the diameter of K . 

It is worth noting that the isoperimetric coefficient above is only smaller by a factor of 2 when 
compared to that of logconcave functions (Theorem [1]) . 

Next, we prove that if we go slightly beyond the class of (l/(n — l))-harmonic-concave functions, 
then there exist functions with exponentially small isoperimetric coefficient. 

Theorem 5. For any e > 0, there exists a l/(n — 1 — e) -harmonic- concave function f : M" M+ 
with a convex support K of finite diameter (i.e., Dk < oo) and a partition M" = SUT such that 

<Cn(l + e)- 



mm{TTf{S),7rf{T)} 
for some constant C > 0. 

To summarize, we have the following table for isoperimetry: 



Nature of f 


Good Isoperimetry? 


Concave 


Yes 


Logconcave 


Yes 


(l/(n — l))-harmonic-concave 


Yes 


(l/(n — 1 — e))-harmonic-concave (e > 0) 


No 


Harmonic- Concave 


No 


Quasi-Concave 


No 



Next we prove that the ball walk with a Metropolis filter can be used to sample efficiently 
according to the (l/(n — l))-harmonic concave distribution function which satisfy a certain Lipschitz 
condition. At a point x, the ball walk picks a new point y uniformly at random from a fixed radius 
ball around x and moves to y with probability min{l, /(y)//(x)}. A distribution do is said to be 
an //-warm start {H > 0) for the distribution vrj if for all S C M", ao{S) < HTrf{S). Let am be 
the distribution after m steps of the ball walk with a Metropolis ffiter. 

We say that a function / : M" has parameters (a, 6) if for all points x, y in the support 

of / such that ||x — y|| < 5, we have max{/(x)//(y), f{y)/f{x)} < a. 
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Theorem 6. Let f : — > M-|- be proportional to an s -harmonic- concave function with parameters 
{a, 6), restricted to a convex body K C M" of diameter D, where s <\/{n — 1). Let K contain a 
ball of radius 5 and ctq be an H-warm start. Then, there exists a radius r for the ball walk such 
that, after 

m > — j5 — log • max 



steps, we have that 

dtv{crm,'n'f) < e, 

for some absolute constant C, where dtv{-,-) the total variation distance. 

Applying the above theorem directly to sample according to the Cauchy density, we get a mixing 
time of O (^( ^""^JI log •niax|^,n|^ using parameters D = ^^^^ (since the probability 

n + 1 

measure outside the Z?-ball is at most e/2H), 5 = 1 and a = e~2~. Using a more careful analysis 
(comparison of 1-step distributions), this bound can be improved to match the current best bounds 
for sampling logconcave functions. 

Theorem 7. Let f be proportional to a Cauchy probability density restricted to a convex set K C M" 
containing a ball of radius ||^~"'^||2 and let ctq be an H-warm starting distribution. Then after 

m > O ( log — 1 

steps with ball-walk radius r = e/Sy/n, we have 

where dtv{., •) is the total variation distance. 

The proof of this theorem departs from earlier counterparts in a significant way. In addition 
to isoperimetry, and the closeness of one-step distributions of nearby points, we have to prove that 
most of the measure is contained in a ball of not-too-large radius. For logconcave densities, this 
large-ball probability decays exponentially with the radius. For the Cauchy density it only decays 
linearly (Proposition [20|) . 



2 Preliminaries 

Let rMx denote a ball of radius r around point x. One step of the ball walk at a point x defines a 
probability distribution over M" as follows. 

PAS)= I min|l,MLy. 
For every measurable set S C the ergodic flow from S is defined as 

cl>(5) = / P,(M" \ S)f{x)dx, 



s 



and the measure of S according to ttj is defined as vrj(S') = jgf{x)dx/ f{x)dx. The s- 
conductance (j)s of the Markov chain defined by ball walk is 

^ - inf 



s<7r/(5)<l/2 T^f{S) — S 
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To compare two distributions Qi, Q2 we use the total variation distance between Qi and Q2, 
defined by dtv{Qi,Q2) = sup^ — Q2{A)\. When we refer to the distance between two sets, 

we mean the minimum distance between any two points in the two sets. That is, for any two subsets 
•S*!, ^2 C R", d{Si, S2) := min{|ti — ^1 : n G Si,v G 52}. Next we quote a lemma from |LS93j which 
relates the s-conductance to the mixing time. 

Lemma 8. Let < s < 1/2 and Hg = sup^^(5')<g |(To(S') — 7rj(5)|. Then for every measurable 
S C and every m >0, 

2\m 



\am{S)-nf{S)\<H, + ^l^l-^^ . 



Finally, the following localization lemma }LS93l IKLS95j is a useful tool in the proofs of isoperi- 
metric inequalities. 

Lemma 9. Let g : R" — * R and h : R" ^ R 6e two lower semi- continuous integrable functions 
such that 

g{x)dx > and I h{x)dx > 0. 



Then there exist two points a,b £ R" and a linear function I : [0, 1] R+ such that 

[ g{{l-t)a + tb)l{ty'-^dt>0 and [ h{{l - t)a + tb)l{tY'^dt > Q. 
Jo Jo 

3 Isoperimetry 

Here we prove an isoperimetric inequality for functions satisfying a certain unimodality criterion. 
We further show that (l/(n— l))-harmonic-concave functions satisfy this unimodality criterion and 
hence have good isoperimetry. 

We begin with a simple lemma that will be used in the proof of the isoperimetric inequality. 

Lemma 10. Let p : [0, 1] — > R+ be a unimodal function, and let < a < (3 < 1. Then 



J a 



p{t)dt >\a- (3\ min <^ / p{t)dt, I p{t)dt 



Proof of Lemma [TW Isoperimetry for 1-dimensional unimodal functions). . Suppose the maximum 

of p occurs Sit t — ^max* If ^max — ^ tlien 

p{t)dt > p{(5) -W- (5\>\a- (5\- p{(5) • |/3 - 1| > |a - /3| • / p{t)dt 

! J 13 

Otherwise, if tmax > a then 

p{t)dt > p{a) ■\a- I3\>\a- I3\- p{a) • |a| > |a - /3| • / p{t)dt 

Jo 

□ 

Now we are ready to prove an isoperimetric inequality for functions satisfying a certain uni- 
modality criterion. 
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Theorem 11. Let f : M" be a function whose support has diameter D, and f satisfies the 

following unimodality criterion: For any affine line L C M" and any linear function I : KCiL — > R_|_, 
h{x) = f{x)l{x)'^~^ is unimodal. Let M" = 5i U 5*2 U 5*3 he a partition ofW" into three non-empty 
subsets. Then 

d{Si, S2) 



vr/(53) > 

Proof. Suppose not. Define g : M" — > 
(d{Si,S2) 



D 
and h 



min{7r/(S'i),7r/(S'2)} . 
M" ^ M as follows. 



9[x) 



D 





f{x) if X G 



if X e 52 ™d ^(^) = ' 

if X E ^3 





d{Si,S2 
D 

[-fix) 



if X £ Si 
-f{x) if X G 52 
if X G 53. 



Thus 



X > and 



h{x)dx > 0, 



Lemma [9] implies that there exist two points a,b £ R** and a linear function / : [0,1] 
that 



[ g{{l -t)a + tb)l{t)''-^dt > and / h{{l-t)a + 
Jo Jo 



th)l{tY-^dt > 0. 



such 



(2) 



Moreover, w.l.o.g. we can assume that the points a and h are within the support of /, and hence 
||a — 6|| < D. We may also assume that a £ Si and b £ S2. Consider a partition of the interval 
[0,1] = Zi UZ2UZ3, where 

Zi = {z£ [0, 1] : (1 - z)a + zb £ Si} . 
For zi £ Zi and Z2 £ Z2, we have 

d(5i, 52) < d{{l - zi) a + zib, (1 - Z2) a + Z2b) < \zi - Z2I • ||a - 6|| < \zi - Z2I D, 
and therefore d{Si, S2) < d{Zi, Z2)D. Now we can rewrite Equation ^ as 

/ /((I - i)a + i6)/(t)"-idt < / f{{l-t)a + tb)litr~^dt 

Jz-i L> Jz-^ 

<d{Zi,Z2) [ f{{l-t)a + tb)l{t)'^-^dt 

J Zi 

and similarly 

/ f{{l-t)a + tb)l{t)'^~^dt <d{Zi,Z2) [ f{{l-t)a + th)l{tT~^dt 

JZz JZ2 

Define p : [0, 1] M+ as p{t) = /((I — t)a + tb)l{t)^~^. From the unimodality assumption in our 
theorem, we know that p is unimodal. Rewriting the above equations, we have 



/ p{t)dt < d{Zi,Z2) p{t)dt and / p{t)dt < d{Zi, Z2) p{t)dt. 

J Z% J Z\ J J Z2 



(3) 



Now suppose Z3 is a union of disjoint intervals, i.e., Z3 = Ui('^i) A); < ai < /3i < 02 < /32 < 
• • • < 1. By Lemma [TO] we have 



ft 



p{t)dt > \ai — (3i\ ■ min 



p{t)dt, I p{t)dt 



ft 
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Therefore, adding these up we get 



Z3 



p(t)dt = 22 P^^")^* 

J Ct i 



> \ai — (3i\ ■ y ^ min <j / p{t)dt, / p{t)dt 
, I Jo J [3, 



> Z2) • min | J 



p{t)dt, / p{t)dt 

Zi JZ2 

since there must be some i such that Zi and Z2 are separated by the interval (oj, But then we 
get a contradiction to Equation ([3|) . This completes the proof of Theorem [TTl 

□ 

3.1 Isoperimetry of (l/(n-l))-Harmonic-concave functions 

We show that (l/(n — l))-harmonic-concave functions satisfy the unimodality criterion used in the 
proof of Theorem II li Therefore, as a corollary, we get an isoperimetric inequality for — 1))- 

harmonic-concave functions, which is a subclass of harmonic-concave functions. 

Proposition 12. Let f : M" M_|_ be a smooth (l/(n — 1)) -harmonic- concave function and 
I : [0, 1] — > be a linear function. Now let a,b M" and define h : [0, 1] — > M+ as h{t) = 
/((I — t)a + tb)l{t)^~^ . Then h is a unimodal function. 

Proof of Proposition [T2l (Unimodality ofl/{n — 1) -harmonic- concave functions). Define (^(x) = {1/ f{x)Y^^^~^\ 
Since / is (l/(n — l))-harmonic-concave, g is convex and we can rewrite h as 

h{t) = /((I - t)a + tb)i{tr-^ - ^ ^^^^ Y ' - f ^(*) ' " ' 



^giil - t)a + tb) J \q{t), 

where q{t) = g{(l — t)a + tb) which is also convex. Also w.l.o.g. we can do a linear transformation 
that transforms / into the identity function l{t) = t without affecting the convexity of q. Thus, it 
suffices to show that if h{t) = {t/q{t))^^^'^^^\ where g is a convex function, then h is unimodal. 
Indeed, 

d , q{t)-t^q{t) 

^h{t)n-l _ dt 



dt ' ' q{tf 

q{t) \2t[^a it) ] - 2q{t)^a {t) - tq{t)^q (t) 



d , , .d , . , d^ 



s^"*)"" = ^ ■ 

If there exists a local optimum for at t = to then 

d^ 

d , d d^ . -toqitof-rr^qito) 

-m-^ = » - = to^,(to) ^ 5^M*o)»-' = — — < 0. 

because to G (0, 1), and -^q (t) > as g is convex. This implies that every local optimum is a local 

maximum and hence there are no convex regions in /i(t)"~^. Hence, there are no convex regions in 
h{t) which implies that h{t) is unimodal. 

□ 

We get Theorem |3] as a corollary of Theorem [11] and Proposition [T2j 
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3.2 Lower bound for isoperimetry 

In this section, we show that {^/{n — l))-harmonic-concave functions are the Umit of isoperimetry 
by showing a (l/(n — 1 — e))-harmonic concave function with poor isoperimetry for < e < 1. 

Proof of Theorem O The proof is based on the following construction. Consider K C R" defined 
as follows. 

iv: = |x : < xi < and + x| + . . . + < (1 - xif 

where 5 > 0. K \s a. parallel section of a cone symmetric around the Xi-axis and is therefore 
convex. Now we define a function / : R" whose support is K. 



fix) 



iixiK, 



where C is the appropriate constant so as to make Tif{K) = 1. By definition, / is a l/(n — 1 — e)- 
harmonic concave function. 

Define a partition R" = 5 U T as 5 = {x G K : < xi < t} and T = R" \ S". The theorem 
holds for a suitable choice of t. [Proof of Theorem [5] (Limit of isoperimetry)] 

We want to show that 

min{^^(5),vr^(r)} ^ ^' 

for some constant c > 1, which means that / does not satisfy the isoperimetric inequality. (By 
abuse of notation, we use TTf{dS) for the area measure defined by / on the boundary of S.) In 
order to achieve this, it seems better for us to choose a value of t that minimizes Trf{dS). 

TTfidS) = K_iC(l - (!-(! + , 

where Vn denotes the volume of a unit ball in R". Simple calculus shows that TTf{dS) is convex as 
a function of t over [0, 1/(1 + 5)] and attains the minimum when 

_ 1 n-l-e 6 

t — ^mr 



1+6 e 1+6 

Moreover, 7rj(95) is decreasing for < t < tmin and increasing for tmin < t < 1/(1 + 5). Thus, 
using t = tmiii to define the partition M" = 5* U T, we get 

TTfidS) = K^lC(l - trnuX-' (!-(!+ 5)tmin)'+'-" 



1 + 6 
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and 



Ix 



7ry(5) = / f{x)d. 
Js 

= Vn-iC / (1 - xir-^ (1 - (1 + 
Jo 

> Vn-lC / (1 - X^r-^ (1 - (1 + S)xi) 

Jo 



where < t' = 2{l\ 5) ^ *™™ 

> Vn-lC{l - ty-^ (1 - (1 + 6)t') t' 



= Vn-lC - + 



1 5 1 



2 2(1 + (5)7 V2/ 2(1 + (5) 



2« 2(1 + S) ' 



and 



7r/(r) = ^/(x)dx 

^1/(1+5) 

= Vn-iC / (1 - (1 - (1 + 

" ^min 

.1/(1+5) 

> Vn-iC / (1 - xi)"-^ (1 - (1 + dxi 

Jt" 

r. . .// 1 1 n-l-e ,5 1 
where tmin < i = z :t • • z < 



1 + 6 n2 e 1 + 6 1 + 6 



> F„_iC(i - t'T-' (1 - (1 + <5)t'y+^-" - t"^ 



> 14-iC 
Therefore, 



,5 f{n-l){e{n+l) + l)Y-^ f 6{n - 1 - e)Y+''''' 6{n - 1 - e) 



1 + 6 J \ v?e ) \ n^e J n^e(l + 6) 



< Cn((l + e)-^") (Using 5 = 1/(1 + e)") 

for some constant C > and 

TTfidS) ^ ( 6n^(i+^)(l + J) \ / 1 
7r/(r) - n-1-5 j \6{e{n + 1) + 1^-^ 

1 

(1 + TTi^)" 



^ C-n^ ( , \ ) (Using 6 = 1/(1 + e)") 



< C2-" 
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for some constant C > 0. Putting these together we have 

min{7r/(5),7r/(r)} 

for some constant C > 0. □ 

4 Sampling s-Harmonic-concave functions 

Throughout this section, let / : M" be an s-harmonic-concave function given by an oracle 

with parameters {a, 6) such that s < l/{n — 1). Let K be the convex set over which we want to 
sample points according to /. We also assume that K contains a ball of radius 5. We state a 
technical lemma related to the parameters and the harmonic-concavity of the function. 



Lemma 13. Suppose f : M" M is a s -harmonic- concave function with parameters {a, 5) as 
defined earlier. For any constant c such that 1 < c < a, if \\x — z\\ < ^J^\ , then < c. 

Proof o/[73 (Modifying parameters) . Let x,y €z M" such that \\x — y\\ < S and let z = (1 — t)x + ty 
for some t G (0, 1). Then, by the s-harmonic-concavity, we have that 

1 - * t 
/(^)> T7-T7 + 



f I — t ta^ 

~ \J{xy ^ J(xy) (Since - y\\ < 6 implies f{x)/f{y) < a) 

m 

{l + t{a' - l))i 

Since, — z\\ < , we get the desired conclusion. □ 

Hence, for the s-harmonic-concave functions with parameters {a, 6), the above lemma states 
that they also have parameters (c, ^^^^jy) for any constant c such that 1 < c < a. In particular, if 

a > 2, this suggests that we may use (2, (^^^jy) as the parameters and if a < 2, then we may use 

(2,5) as the parameters. Thus, the parameters are (2,min{J, j^^^rj^})- 

In order to sample, we need to show that K contains points of good local conductance. For 
this, define 

\ vol(rB^) -4, 

The idea is that, for appropriately chosen r, the log-lipschitz-like constraint will enforce that the 
points in Kj. have good local conductance. Further, we have that the measure in Kr is close to the 
measure of / in based on the radius r. 

Lemma 14. For any r > 0, the set is convex and 

Proof o/[77] (Points of good local conductance). Now, the convexity of is a direct consequence 
of the Brunn-Minkowski inequality: for compact sets A, B and their Minkowski sum A + 
vol {A + S)^/" > vol (^)^/" + vol (S)^/". To prove the second part, we need the following lemma 
paraphrased from |KLS97] . 
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Lemma 15. Let K be a convex set containing a ball of radius t. Then J^g^ Iy&{x+rM)\K ^V^x < 
^-^vol{K)vol{rM). 

The target density / (with support K) can be viewed as foUows: first we pick a level set L[t) 
of /, with the appropriate marginal distribution on i, then we pick x uniformly from L{t). 

Now consider any level set L{t) where t is picked according to the appropriate marginal dis- 
tribution. If L{t) does not contain a ball of radius (5/2, then the probability of stepping out of K 
from any point in L{t) is 0. If L[t) contains such a ball, the probability of stepping out is bounded 
above using Lemma [15] by r^fnjb. That is, 

vol (rm^. \ K) ^ rVn 
vol (rB) - b 

where x is a random point in L{t). Consider a random variable g{x) = when x is a 

random point in L{t). Since by the above inequality E{g{x)) < ry/n/5, we have that 

Pr(.(:.0>^^)<i 

This implies that at most 1/4-th of the fraction of points in L{t) step out of K with probability 
greater than Ar^/n/S. Hence, at least 3/4-th of the fraction of points in L{t) step out of K with 
probability at most Ar^/n/5. 

That is, 3/4-th of the fraction of points in L{t) remain within K with probability at least 
1 - {Ar^/5). 

Hence 7r/(K^) > 1 - {Ar^/6). □ 
4.1 Coupling 

In order to prove conductance, we need to prove that when two points are geometrically close, then 
their one-step distributions overlap. We will need the following technical lemma about spherical 
caps to prove this. 

Lemma 16. Let II be a halfspace in and be a ball whose center is at a distance at most 
tr / y/n from H . Then 

_£ 2wo\(Hr\rB) 
^"^ ^ vol(rB) 

Lemma 17. For r < min{5, ^^^^^}, ifu,v S Kr, \\u — v\\ < r/16y/n, then 

7 

16 



Proof. We may assume that f{v) > f{u). Then 

1 

vol (rB) 7rB„nrB„n/^ "'^'^ T' f{'^ 



dtv{Pu,Pv)<^ TTl^ / min|l,^^y^ 
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Let us lower bound the second term in the right hand side. 

> ^-^ vol (rBj; n r]B„ n iC) (Consequence of Lemma [T3|) 

> (vol (rB^) - vol (rB„ \ rB„) - vol (rB^ \ K)) 

- {I) ("""^ ^'^^"^ " Y6 """^ ^"^^^ " Y6 """^ ^'^^^ 

where the bound on vol (rB^ \ rB^) is derived from Lemma [16] and vol (rB^ \ K) is bounded using 
the fact that v £ K^- Hence, 

7 

dtv{Pu, Pv) < 1 — 777 
lb 

□ 

4.2 Conductance and mixing time 

Consider the ball walk with metropolis filter using the s-harmonic-concave distribution function 
oracle (whose parameters are [a, 6)) with ball steps of radius r. 

Lemma 18. For any ei > 0, let D he the diameter of the hall such that 7r/(DBo) > 1 — -^^^ ^ — 
he such that TTf{S) > ei and 7rf(W^\S) > ei. Then, for hall walk radius r < minj^J^, j;^^}, 
we have that 

HS) > ^9-^min{^^(5) - 6i,7r;(M"\5) - ei} 

Proof of Lemma \18l Given K as the convex set over which we want to sample points according to 
the (l/(n — l))-harmonic-concave distribution, define Kr as above. Further, for all subsets A<^ K, 
we have that 

7rf{A n K') = TTf{A n DKr) 

6 S 

> TTfiA) — ei (by Lemma [HI using r < — —) (4) 

8^/n 

Using S, define ^i, 52,53 as follows. 

51 = |xGS : P,(M"\5)<^ 

52 = |xeM"\5 : P,{S) < ^1 

53 = M"\(5iUS2). 

Also define S'^ as 

Si = SinKr, fori = 1,2, 3. 
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The ergodic flow of S can be written as 

HS) = \( f P^iMJ" \ S)f{x) dx+ [ P.{S)f{x) dx] 

^ \JS JK„\S J 

Suppose TTf{S{) < TTf{SnKr)/2, then 7r/(S^) > 7rf{SnKr)/2 because 5 n i^,. C S[US'^. Thus 
HS) > ^TTfiS n Kr) > ^ (7r^(5) - 6i) (By Q) 

which imphes the lemma. So, we may assume that Trf{S[) > 7rj(5n K^.)/2, and similarly 7rj(52) > 
TT/ ((M" \ 5) n AV) /2. Then, using Theorem H 



Now, for any u £ Si, v S2, dt^{Pu,Pv) > 1 - 2 • max{P„(M" \ S),Py{S)} > 1 - ^. Also, 
r < min{^, < min{5, j^]. Hence, by Lemmas d{Si,S2) > Therefore, 

HS) > ^ • • ^ • min{7r^(5) - 6i,^y(M" \ 5) - ei} By © 

□ 

Using the above lemma, we prove Theorem [H 
Proof of Theorem O On setting e\ = e /2H in Lemma [TBI we have that for ball- walk radius r = 

r 

> 



By definition Hg < H ■ s and hence by Lemma [8l 



|o-„(5') - 7r/(5')| <H-s + H-expl - ^n^D'^ \ 



which gives us that beyond 

2^'^nD'^ , 2H 

m > — log 

e 

steps, {(JmiS) — TTf{S)\ < e. Substituting for r, we get the theorem. □ 
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4.3 Sampling the Cauchy density 

In this section, we prove certain properties of the Cauchy density along with the crucial coupling 
lemma leading to Theorem [71 Without loss of generality, we may assume that the distribution 
given by the oracle is, 

fix) 0^1 1/(1 + INn^ if^ei^, 

I otherwise. 

This is because, either we are explicitly given the matrix A of a general Cauchy density, or we can 
compute it using the function / at a small number of points and apply a linear transformation. 
Further, note that by the hypothesis of Theorem [71 we may assume that K contains a unit ball. 

Proposition 19. The Cauchy density function is (l/(n— 1)) -harmonic- concave. 

Proof of Proposition [iPI (Cauchy is l/(n-l) -harmonic- concave). To check for (l/(n— l))-harmonic- 
concavity, we need to check that 

i 

is convex. This follows from the following two observations: 

^- 2(n-l) ^ 2 

2. (1 + '^Zi^lY^'^ is convex. 

□ 

Proposition [20l says that we can find a ball of radius 0{^/n/el) outside which the Cauchy density 
has at most ei probability mass. 



Proposition 20. 



Pr I ||x|| > ^ — J < ei 



Proof of Proposition \20\ (Ball of large mass). 

■^I^ll>* n _L ||^||2>,(n+l)/2 
Pr(H >t) = ^^MJ 

(1 + ||xf )("+l)/2 

/g„_i du ■ ^^2)(n+l)/2 

~ oo 7-"-l 

/§n-i du ■ /g _^^2)(n+l)/2 

f oo 



using polar coordinates 



roo I , 

Jt (l + ^2)(n+l)/2 ^'^ 



Jo (l + ^2){n+l)/2 ^'^ 
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Now we will analyze the numerator, call it N, and the denominator, call it D, separately. 



N 



J (1 _^ j,2)(n+l)/2 



dr < 



dr 



t' 



(6) 



and 



D 



r.n~\ 



(l+r2)("+i)/2 
sin"-i B \ 



dr 



sec^ 9 dO 



using r = tan ( 



7r/2 



sin"-^ 9 dB 







sin" 2 Q I 
n — 1 

n-2 



7r/2 



+ 



2 /-"/^ 



n — 1 



sin"-3 



n — 1 
r (n-21!! 







(n- 1)!! 
vr (n-2)!! 

^4 ' (n-1)!! 



sin"~3 9 dO 
, if n is even. 



, if n is odd. 



by continuing the recursion 



vr (n-2)! 
- 4 " (n-1)! 



4 TT^/n 
1 



by Wallis' inequality 



Therefore, from Equations ([6]) and ([7]) we get 



(7) 



Pr(||x|| >t)<-<^— . 



This implies 



Pr Ibll > 



2V2n 

ei 



<ei. 



□ 



Proposition 1211 shows the smoothness property of the Cauchy density. This is the crucial ingre- 
dient used in the stronger coupling lemma. Define Kr as before. Then, 



Proposition 21. For x G K-r, let 



4r||2;| 



C^ = {ye rM^ : |x • (x - y)\ < -^^} 



'n 



and y £ Cx- Then, 



M > 1 _ 4rV^ 

/(y) 
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Proof of Proposition [21\ (Smoothness property). We have that, 

= IkiP + l|y~2:|p + 2x- {x — y) 
,2 8r||x|| 



> \\x\ 



n 



Therefore 



f{y) 



U \ 2 



> 1 



1 + 

8r| Ixl 



> 1 — 4r\/n 



V^(l + ||x||2^ 

4r 



rt+l 
2 



n + 1 
2 



max 



1 + 



□ 



Finally, we have the following coupling lemma. 
Lemma 22. For r < l/^/n, if u,v £ Kj., \\u — v\\ < r/16^/n, then 

dtv{Pu, Pv) < -■ 

Proof of Lemma\2S\ (Coupling lemma for Cauchy). We may assume that f{v) > f{u). Then, 



dtv{Pu, -ft)) < 1 



1 



vol (rB) y^B„nrB, 



min < 1 , 



m 

f{v) 



dy 



Let us lower bound lower bound the second term in the right hand side. 



min < 1 



m 

f{v) 



dy> 



min < 1 



ivnrM„nKnCv 



m 

" f{v) 



dy 



> (1 - 4r Vn) vol (rB^ n rB„ nCyHK) (by Lemma EI]) 

> (1 - Ar^/^) (vol (rB^) - vol (rB^, \ rB„) - vol (rB^, \ C^,) - vol (rB^ \ ET)) 

> (1 - Ar^/n) (vol (rB^) - — vol (rB) - — vol i 



16 



16 



e ^vol 



> (1 - 4:r^/n) ^Y^^ vol I 



where the bounds on vol (rBy \ rB^) and vol (rB^, \ C^) are derived from Lemma[T6]and vol (rB^ \ X) 
is bounded using the fact that v £ Kr- Since r < l/-v/n) 

dtv{Pu,Pv) < -I g ^ < t: 

16 2 

□ 

The proof of conductance and mixing bound follow the proof of mixing bound for s-harmonic- 
concave functions closely. Comparing the above coupling lemma with that of s-harmonic-concave 
functions (Lemma ll7p . we observe that the improvement is obtained due to the constraint on the 
radius of the ball walk in the coupling lemma. In the case of Cauchy, a slightly relaxed radius 
suffices for points close to each other to have a considerable overlap in their one-step distribution. 
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4.4 Discussion 



There are two aspects of our algorithm and analysis that merit improvement. The first is the 
dependence on the diameter, which could perhaps be made logarithmic by applying an appropriate 
affine transformation as in the case of logconcavc densities. The second is eliminating the depen- 
dence on the smoothness parameter entirely, by allowing for sharp changes locally and considering 
a smoother version of the original function. Both these aspects seem to be tied closely to proving 
a tail bound on a 1-dimensional marginal of an s-harmonic concave function. 
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5 Appendix: proofs 

5.1 Sampling the Cauchy density 

The following lemma gives the parameters for the Cauchy distribution function. 
Proposition 23. // ||?/ — < 1/n, then 

m > 1 



m - e 

Proof. Let denote the directional derivative of a function along u. Then 

log = log fi^) - log fiv) 

f{y) 

< sup sup ||Vulog/(z)|| • - y|| 
zeiR" ||u||=i 

= sup sup 7^ ||Vn/(2;)|| • ||x - ?/|| 
zeiR" ||u||=i JK^) 



\x-y\\ sup sup ||V„/(z)||. (8) 

zeM" jkz) \\u\\=1 
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We know that by definition 



l + \\z\\ 



(n+l)/2 ■ 



for some constant c that includes det(A) ^ and the normalizing factor for Cauchy distribution. 
Thus 



sup ||V„/(z)|| = sup 

1|m|| = 1 |iii||=l 



sup 

\\u\\ = l 



E 



"' ii.fr -^..u. 



i=l 

c(n + 1) \\z\ 



l + \\z\ 



(n+3)/2 ' 



usmg u 



Plugging this in Equation ([8]) we get 

log ^< X- y sup \ 

f{y) 2eR" 1+ k 



\x — y\\ (n + 1) sup 
\x — y\\ (n + 1) sup 



1 + Ikll 

r 



\x - y\\ (n + 1) 



< 1 



using ||x — y\\ < 1/n. 



Therefore 



ZM>i 



□ 
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